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PREFACE 

With  the  advent  of  the  network  computer  has  come  an  increasing 
movement  towards  developing  the  necessary  analytical  tools  to  properly 
evaluate  and  improve  these  networks.   One  such  tool  is  system  modeling 
to  assist  in  performance  evaluation  of  networks  and  computer  centers  whose 
usefullness  and,  consequently,  communication  flow  is  daily  increasing. 
While  much  has  "been  said  of  performance  evaluation  for  particular  centers, 
little  has  "been  done  concerning  the  analysis  of  the  entire  network.  Our 
purpose  is  to  postulate  a  queueing  theory  model  of  a  theoretical  network 
and  to  use  this  model  to  predict  such  measures  as  the  number  in  the  system, 
the  number  in  the  queue,  and  system  efficiency. 

Under  the  assumptions  of  Poisson  arrivals,  exponential  service 
times  and  a  restricted  queue  length,  the  mathematical  model  is  utilized 
to  develop  the  steady  state  equations  for  the  two-center  and  the  n-center 
network.   Then,  a  priority  scheme  is  implemented  and  the  steady  state 
equations  are  rederived.  With  these  two  varying  assumptions,  conclusions 
are  drawn  as  to  their  effect  on  system  efficiency  and  the  number  in  the 
queue . 

Lastly,  the  relevance  of  proposing  an  analytical  model  is  discussed. 
The  mathematical  model  is  compared  to  existing  networks  to  verify  its 
authenticity  and  accuracy.  To  the  extent  that  such  models  aid  our 
comprehension  of  the  internal  mechanisms  and  balances  and  thereby  shape 
future  networks,  they  serve  a  necessary  and  useful  purpose. 
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1.    INTRODUCTION 

Multiprocessor  network  systems  have  "become  a  reality.  With 
the  reality  comes  the  added  burden  of  increasing  speed  and  communication 
flow  between  centers.  Networks  offer  little  advantage  over  conventional 
processing  techniques  if  centers  operate  with  virtual  independence  of 
one  another . 

The  expense  of  a  network  becomes  feasible  only  if  loads  at  one 
center  can  be  merged  with  lighter  loads  at  another  center.  Specialized 
services  and  skilled  personnel,  which  are  not  economically  viable  for  a 
single  center,  become  viable  when  the  larger  population  of  potential 
users  is  taken  into  consideration.   In  addition,  with  much  of  the  system 
saturation  reduced,  turnaround  time  can  reach  optimum  levels.  These 
are  but  a  few  of  the  advantages  which  can  be  gained  by  the  emergence  of 
the  network  as  part  of  the  computer  technology. 

Networks,  such  as  ARPA  or  TUCC  [8, ho]    can  be  compared  to  the 
large  business  conglomerates.   In  both  the  essential  need  is  to  consoli- 
date for  reduction  of  overhead  costs  and  amplification  of  profits.  These 
two,  business  and  networks,  are  more  than  similar,  however,  they  are 
compatible.  With  the  expanding  market,  the  network  offers  an  economic 
method  of  operating  over  a  large  data  base  in  a  geographically  distributed 
region,  thus  reducing  the  amount  of  paperwork  necessary  in  accounting 
and  payroll,  for  example.  However,  not  only  are  networks  profitable 
for  the  large  conglomerate,  they  are  also  advantageous  to  the  smaller 
companies.  This  is  their  prime  attraction. 


With  the  emergence  of  networks  to  the  computer  technology,  the 
next  step  is  to  provide  analytic  guidelines  for  the  behavior  of  the 
networks,  schemes  for  load  leveling  and  algorithms  to  control  phenomenon 
such  as  system  saturation.  Thus,  networks  must  be  analyzed  in  their 
entirety  instead  of  being  considered  as  a  collection  of  disjoint  centers. 
Without  a  doubt,  this  presents  added  problems  and  challenges.  Load 
leveling  involves  assessing  a  situation  which  is  never  stationary  and 
from  that  assessment  deciding  upon  an  appropriate  strategy.  Similarly, 
when  a  job  enters  the  network,  the  center  where  this  job  will  be  processed 
must  be  determined  so  that  such  goals  as  economy  and  low  turnaround  time 
may  be  met.  These  goals  may  not  coincide  at  any  given  point  and  any 
resolution  of  the  conflict  is  complicated  by  the  great  number  of  decision 
points  at  any  one  moment. 

However,  a  more  important  problem  is  the  task  of  defining  a 
general  network  structure  that  can  be  readily  analyzed  without  too  great 
a  degree  of  simplification.  A  problem  to  which  we  now  turn. 

The  simplest  network  consists  of  a  single  center.  The  flow 
through  the  center  is  determined  by  the  arrival  pattern  of  the  commodity 
(customers  or  widgets)  which  utilize  the  center  for  a  given  period 
of  time  and  the  service  pattern  of  the  center.  Clearly,  if  the  customer 
demand  exceeds  the  system  capacity,  then  the  center  is  unequipped  to 
service  this  type  of  arrival  pattern  satisfactorily. 


Consider  the  example  of  a  single  chair  barber  shop.   If  the 
customers  arrive  at  a  steady  rate  p,  meaning  in  uniformly  spaced  time 
intervals,  and  the  barber  can  cut  hair  at  a  uniform  rate  of  \i,    then 
P  <  iu  means  that  the  barber  will  be  able  to  service  all  of  his  customers 
for  that  day.  p  >  \i   means  that  customers  arrive  faster  than  he  can  cut 
hair  and  a  waiting  line  or  queue  will  form.   In  this  case,  the  queue 
will  grow  without  bound  (until  closing  time). 

In  constrast  to  the  uniformly  spaced  arrivals,  consider  random 
or  Poisson  arrivals .distributed  around  a  mean  p.   This  says  that  the 
exact  arrival  time  of  any  one  customer  is  unpredictable,  but  most  will 
arrive  within  p  of  each  other.  Similarly,  suppose  the  time  it  takes 
the  barber  to  cut  hair  is  randomly  distributed  around  a  mean  of  ju . 
Again,  most  hair  cuts  will  take  time  ju  to  complete,  but  some  may  take 
a  much  longer  or  a  much  shorter  time.  Because  both  our  barber  and  his 
customers  are  so  unpredictable,  it  can  be  expected  that  a  waiting  line 
will  form.   This  might  happen,  for  instance,  when  two  customers  arrive 
a  short  time  apart,  before  the  barber  has  time  to  completely  service  the 
first  arrival.  .At  the  same  time,  periods  of  idleness  might  exist,  for 
instance,  when  two  customers  arrive  far  enough  apart  that  the  barber  has 
finished  with  the  first  before  the  arrival  of  the  second.  However,  given 
the  means  of  p  and  ju,  it  can  again  be  stated  that  when  p  >  ju,  the  waiting 
line  will  grow  without  bound.   In  other  words,  customers  are  on  the 
average  arriving  faster  than  the  barber  can  service  them. 


The  network  problems  are  even  more  interesting  than  these 
problems.   One  such  network  problem  is  the  transportation  problem, 
shown  in  Figure  1.1.  A  manufacturer  wishes  to  ship  a  number  of  units 
of  each  widget  from  several  factories  to  several  warehouses.  Each 
warehouse  requires  a  certain  number  of  units  of  each  widget,  while  each 
factory  can  supply  up  to  a  certain  amount.  Only  the  routes  indicated 
may  be  used  for  shipment  and  the  problem  is  to  minimize  the  transportation 
cost  for  shipment  from  factory  to  warehouse .  Suppose,  in  addition, 
that  warehouse  #1  can  never  keep  enough  of  A  in  stock  and  warehouse  #2, 
enough  of  B.   Then,  the  problem  broadens  to  include  maintaining  a  steady 
flow  of  these  products  to  the  specified  warehouses.  A  solution  of  this 
type  of  problem  is  found  in  the  literature  [2  0]. 

Another  example  concerns  the  random  arrivals  or  stochastic 
processes  used  earlier.  For  this  example,  suppose  there  exists  a 
network  of  telephone  lines  whose  topological  structure  is  given  in 
Figure  1.2.  Each  branch  represents  a  two-way  connection  between  cities, 
each  with  the  capacity  in  number  of  calls  per  minute  as  indicated.  Since 
the  time  and  length  of  a  call  is  unpredictable,  this  situation  closely 
parallels  our  barber  shop  example .  However,  there  are  added  complications 
in  that  the  origin  and  destination  of  the  call  is  not  known  beforehand, 
implying  the  existence  of  a  store -and- forward  mechanism.  Again,  as  with 
computer  networks  one  city's  center  may  be  overloaded  and  another  idle. 
Each  city  has  a  center  to  process  telephone  calls,  much  like  a  computer 
center.  Each  call  must  queue  up  in  a  waiting  line  and  wait  transmission 
if  the  center  is  busy.   If  all  the  lines  are  busy,  then  the  center  is 
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Figure  1.1.  A  Typical  Network  System  with  3  Factories  and  5  Warehouses 


said  to  be  operating  at  capacity  and  the  finite  queue  is  full.   Suppose 
transmission  of  the  call  has  an  exponential  service  time  ft  and  suppose 
each  call  lasts  an  exponential  time  with  mean  ju.   Then,  this  system  can 
be  viewed  as  being  composed  of  a  dual  server T   the  transmission  and 
communication  servers.   Since  there  is  no  mechanism  to  save  incoming 
calls  when  the  telephone  is  in  use,  a  telephone  has  no  queue  on  its 
communication  server.  We  say  that  such  calls  during  a  busy  period  are 
lost  to  the  system. 


Furthermore,  each  time  a  person  dials  the  phone  he  can  view  the 
destination  as  being  determined  by  a  probability  matrix  A  which  gives 
the  probability  that  a  call  from  him,  center  i,  is  placed  at  his  neighbor's, 
center  j.   This  is  done  with  probability  a.  ..   Then  if  the  number  of 
calls  he  makes  is  randomly  distributed  around  a,   Cta. .  is  part  of  the  total 
number  of  calls  his  neighbor  is  receiving.   (Of  course,  they  are  receiving 
calls  other  than  his.) 
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Figure  1.2.  Distributed  Telephone  Network 

These  examples  separate  into  two  groups:  Networks  and  non- 
networks;  random  arrivals  and  uniform  arrivals.   It  is  to  the  problem 
of  random  arrivals  in  a  network  which  we  will  speak.   The  solution  to 
the  barber  shop  problem  with  random  arrivals  is  included  in  a  broad 
class  of  queueing  theory  problems,  of  which  the  uniform  arrivals  represent 
a  special  case. 
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Specifically,  we  wish  to  focus  our  attention  on  the  development 
of  a  general  queueing  theory  model  for  a  network.   Once  this  has  been 
accomplished,  measures  such  as  the  number  in  the  queue  or  system 
efficiency  can  be  predicted.  These  measures  are  the  real  interest  in 
any  network,  since  if  a  network  is  to  operate  economically,  it  must  not 
only  function,  but  also  show  profits.  The  most  obvious  way  to  achieve 
profits  is  for  the  system  manager  to  optimize  system  productivity.   This 
is  done  successfully  only  if  the  manager  has  some  idea  of  what  is  causing 
his  bottleneck  and  why.  Further,  he  needs  to  know  how  system  changes 
will  affect  system  utilization.  For  example,  how  increasing  or  decreasing 
job  storage  (disc  or  tape)  will  affect  turnaround  time. 

Why  networks?  Hasn't  this  class  of  problems  been  considered 
previously?  This  may  be  true  enough,  but  networks  add  a  new  dimension 
to  these  problems.  A  network  computer  has  to  decide  when  to  transmit  a 
job  and  when  to  process  it  on  location.   Often  the  user  wants  the  quickest 
turnaround  possible,  how  is  this  to  be  met  in  a  network?  Load  leveling 
is  now  a  necessity  if  centers  are  to  cooperate  within  the  network.   Priorities 
come  into  play.  Which  job  should  have  a  high  priority  and  which  job  a 
low  one?  Is  the  assignment  a  universal  one  or  does  it  vary  from  center  to 
center?  How  does  a  varying  priority  affect  the  computer  manager's 
transmission  decisions?  The  accounting  and  business  management  with  the 
related  data  base  complications  opens  up  a  new  wealth  of  problems.  Which 


center  charges  for  the  job  processing--the  initial  or  the  end  center? 
How  is  the  integrity  of  the  data  "base  protected  against  unwelcome  users? 
While  these  problems  are  mentioned  for  completeness,  we  wish  to  concern 
ourselves  only  with  those  problems  in  the  realm  of  modeling  and 
performance  evaluation. 

For  convenience,  we  define  a  network  center  as  a  local  and 
independent  source  of  one  or  more  processors.  A  network  computer  is 
defined  to  be  an  interconnected  set  of  network  centers.  The  transmitter 
for  each  center  has  an  exponential  service  time  and  operates  in  the  full 
duplex  mode .  Therefore,  no  messages  are  forced  to  wait  for  a  free 
receiving  transmitter.  The  exponential  nature  of  the  transmitter's 
service  comes  from  the  arbitrary  nature  of  the  transmitted  job  size. 
Clearly,  these  can  be  of  any  size  and  the  length  of  the  job  would  deter- 
mine the  transmitting  time.   The  exponential  assumption  simply  says 
that  most  jobs  cluster  around  the  mean,  but  there  may  exist  very  short 
or  very  long  jobs.  Furthermore,  note  that  no  rationale  for  why  a  job 
has  to  be  transmitted  is  given  at  this  time.  We  simply  have  said  that 
part  of  those  jobs  submitted  are  transmitted  without  applying  any  rules 
or  heuristics  to  decide  what  characteristics  these  jobs  must  have. 

There  are  three  network  configurations  which  should  be  mentioned 
at  this  time.  The  first  in  Figure  1.3a  is  the  star  network,  which  consists 
of  a  center  node  which  acts  as  the  central  message  switching  center. 
The  outside  nodes  are  characterized  by  one  path  leading  in  and  out 
connecting  it  to  the  center  node.  TUCC  is  an  illustration  of  this  type  of 
network  topology.  The  distributed  network,  shown  in  Figure  1.3"b>  is 


distinguished  by  the  number  of  alternate  routes  to  any  one  node.   It 
does  not  suffer  from  the  vulnerability  of  the  central  switching  node 
inherent  to  the  star  network.  ARPA  exemplifies  this  network  philosophy. 
The  third  type  (Figure  1.3c)  is  the  ring  structure,  chosen  for  the 
Distributed  Computer  System.   The  major  advantage  gained  by  this  topology 
is  that  the  reduction  of  links  still  allows  reliability  and  at  the 
same  time  reduces  costs.  With  this  introduction,  we  now  turn  to  the 
problem  of  model  definition. 


a.  Star  net  Configuration 


b.  Distributed  Network 


c.  Ring  Configuration 


Figure  1.3.   Network  Topology 
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2.    NETWORK  COMPUTER  MODELING 


2.1.   Model  Description 

Suppose  we  are  given  a  network  computer  of  t  centers  in  the 

th 
general  form  of  Figure  2.1,  and  that  the  i —  center  consists  of  c  computers 

having  an  exponential  service  time  distribution  of  \i.  .  The  input  stream 

to  the  i —  center  consists  of  two  parts:   those  jobs  destined  for  service 

completion  at  center  i  and  those  jobs  destined  for  service  completion  at 

center  j,  j  ^  i.   Those  jobs  destined  for  service  at  center  j  arrive  at 

center  i  from  a  Poisson  distribution  with  an  interarrival  rate  of  Ql., 

x' 

and  those  jobs  requesting  service  at  center  i  arrive  with  an  interarrival 

rate  of  B .  . 

As  determined  by  their  destination,  both  types  of  input  queue 

up  in  separate  finite  queues,  called  transmission  and  service  queues, 

and  wait  for  service.   The  finite  queue  assumptions  are  required  since  the 

storage  capacity  at  each  center  is  bounded.   If  the  center  is  near 

saturation,  clearly  a  portion  of  the  jobs  entering  will  be  turned  away 

for  lack  of  space.   (Since  we  are  generally  interested  in  the  solution 

at  steady  state  and  not  at  the  saturation  point,  the  finite  queue  assumptions 

are  not  restrictive.)  We  say  that  the  service  queue  at  each  center  is 

bounded  by  length  N.  >  1  and  the  transmission  queue,  by  length  M^>  1,  where 

N.  and  M.  may  differ  from  center  to  center.   The  transmitter  for  each 
l      l  * 

center  has  an  exponential  service  time  of  fi.,  and  operates  in  the  full 
duplex  mode.  Therefore,  no  messages  are  forced  to  wait  for  a  free 
receiving  transmitter  and  no  blocked  state  is  assumed. 


Input 
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CENTER  1 


processor 
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Figure  2.1.   Three  Center  Network 
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Assume  for  the  moment  that  no  priorities  between  centers 
exist  and  that  messages  that  are  sent  from  center  i  to  center  j  enter 
the  finite  queue  for  the  server  at  center  j .  Then,  the  true  arrival 
rate  for  center  j,  w.,  is  given  by 


I 


w. 


6   +  E  cu.a. 


1=1 


where  I  is  the  number  of  network  centers  and  a. .  is  the  probability  that 
the  job  is  sent  from  center  i  to  center  j .  Assume  also  that  each  of  the 
-t  centers  has  a  compatible  though  not  necessary  equal  capacity.  Then, 
the  following  illustrates  the  queue  structure  for  the  i —  center. 

a.a.. 

i  lk 


cc. 


Input  i  M— £>  Q  Q 


IOO 


transmitter 


.th 


processor 


Figure  2.2.   Queue  at  j —  center  showing  part  of  transmission 
input  from  other  centers  in  net. 

Our  view  of  the  network  is  much  the  same  as  that  of  an  outside 

th 
observer.  We  see  jobs  coming  in  at  rate  8.  and  a. .   to  the  i —  center. 

J      J 

In  addition  to  the  stream  8.,  our  observer  sees  the  stream  a.  a. ,,1  f   j, 
of  jobs  transmitted  from  the  other  centers  in  the  network.  These  jobs 


queue  up  together  with  the  stream  8..  and  together  comprise  the  input 

J 
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for  center  j  .   Those  jobs  arriving  at  rate  OL .   are  transmitted  to  center 
i,  i  ^  j,  at  rate  o .,  while  those  jobs  remaining  at  center  j  complete 

J 

service  at  rate,  ju. . .   Internal  to  this  structure  is  the  priority  assign- 

J 

ment,  if  any,  and  the  load  leveler  for  that  particular  center,  etc. 
Consider  w 


J 


I 


"w..  =  8  .  +  Z  OL.   a  . 
i=l 


0   r  J   i==1  i  ij 


=  B  .  +  a.  a.  . .+  . .-.  +  a  .  .a..  .  +  a  .  .  a  .  .  .+  ...+  a  a  . 


(some  of  which  may  be  zero) 


This  implies  that  each  center  has  a  probability  matrix  A  of  the  form: 


FROB. 
TOTAL 


1 

2 

3 

I 

0 

1 
0 

2 
0  - 

3 

0 

1 
1 
1 


where  a. .  is  the  probability  that  a  job  is  sent  from  center  i  to  center  j. 

Now  for  the  case  where  t  =  2,    all  transmitted  units  are  from 
center  1  to  center  2,    and  a .  .  =  1,  whenever  i  ^  j.   Then  the  probability 
matrix  A  simplifies  to  the  following. 


1 
2 


1 

2 

0 

1 

1 

0 

Total 

1 


lU 


The  arrival  rate  for  center  j,  w.,  j  =  1,2  becomes 


w.  =  Pj  +  a.    1  /  J  , 


or  for  compactness 

w  =  3  +  ol 

since  for  <£,=  2  the  subscripts  are  unique  for  a  given  center. 
In  summary,  we  have  assumed  the  following: 

1.  Input  Population:  We  assume  an  infinite  input  population 

■with  a  Poisson  arrival  rate  of  (3  .  for  those  jobs  which  arrive  at  center 

j  and  are  serviced  at  center  j  .  A  Poisson  arrival  rate  of  OL .  is  assumed 

J 

for  those  jobs  arriving  at  center  j  and  demanding  service  at  center 
i,  i  ^  j .   The  arrival  rate  to  the  j —  processing  center  is 

I 

w.  =  6  .  +  E  OL.    a.  . 

where  -L  is  the  number  of  centers. 

2.  Service  Mechanism:  Dual  server  consisting  of  a  transmitter 

with  an  exponential  service  time  of  ft.  at  the  i —  center  and  a  processor 

with  an  exponential  service  time  of  ju  at  the  i —  center. 

i 

th 

3.  Queue  Discipline:  At  the  i —  center,  the  transmitter  has 

a  queue  bounded  by  length  M.  >  1  and  the  processor  has  a  queue  of  length 
N.  >  1.  Entrance  to  the  queue  is  first-come,  first-served. 
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h.  Routing  Procedure:  This  is  determined  by  the  probability 
matrix  A  which  gives  the  probability  a. .  that  a  transmitted  job  is  sent 
from  center  i  to  center  j . 


2 .2 .   Temporal  Behavior 

Now  that  the  network  has  been  characterized,  we  turn  to  the 
derivation  of  the  queueing  model. 

Consider  the  case  where  there  are  two  centers  in  the  network. 
Figure  2.3  illustrates  the  relationship  between  the  transmitter  and  the 
processor.   The  exponential  arrival  rate  for  the  processor  at  center  2 
is  j3  and  jit  is  its  service  rate.  As  noted  earlier,  if  a  unit  has  been 
transmitted,  it  must  come  from  center  1.   The  exponential  arrival  rate 
to  the  transmitter  for  center  1  is  a  and  fi  is  the  service  rate  for  the 
transmitter.   (Note  that  for  convenience  of  notation,  we  have  deleted 
the  subscripts  from  the  processor  for  center  2  and  the  transmitter  for 
center  1.)   The  dotted  section  of  Figure  2.3  indicates  the  system  under 
consideration . 

The  queue  discipline  is  first-come  ,  first-served  and  no  preemption 
is  permitted  in  either  server.   In  the  first  server,  the  transmitter's 
queue  length  has  been  restricted  to  M;  while  in  the  second  server,  the 
queue  is  restricted  to  N.  No  blocking  will  occur  in  the  transmitter 
at  center  1  if  center  2  has  a  queue  of  length  N  and  a  transmission  is 
attempted.  Units  that  enter  when  either  queue  is  full  are  lost  to  the 
system. 
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CENTER  1 


Figure  2.3.   Two  Center  Network 


IT 

One  assumption  should  be  mentioned  at  this  point.   The  arrival 
rate  to  the  transmitter  is  a.      The  output  of  the  transmitter  will  also 
he  a,    if  the  queue  (M)  is  infinite  [  7 ] •   If  this  queue  is  not  infinite, 
the  input  to  center  2  will  not  necessarily  be  Poisson  and  in  general, 
the  arrival  rate  to  center  2  from  the  transmitter  will  not  be  a.     However, 
the  arrival  rate  is  assumed  to  be  approximately  a   at  steady  state. 

Let  P   (t)  denote  the  probability  that  at  time  t  there  are 
m,  n 

exactly  m  units  in  the  first  system  and  exactly  n  units  in  the  second 
system  at  time  t  (0  <  m  <  M,  0  <  n  <  N) .  We  adopt  the  following  notation: 

1.  w  =  effective  arrival  rate  to  center  2. 

w  =  a   +  p 

2 .  p  =  traffic  intensity  at  center  2 . 

PT  =  Wu      ■ 
3-      p-,  =  traffic  intensity  for  the  transmitter  at  center  1. 

p  =  a/a     . 

h.      pp  =  traffic  intensity  at  center  2,  exclusive  of  transmissions 

P2  =  P/jLl   • 

5 •  L  =  average  number  in  service . 
s       to 

6-   t)  =  system  efficiency. 

L  /2   . 

7>   E(m, n)  =  average  number  in  system. 

Note  that  the  system  is  totally  characterized  by  the  probabilities  P    at 

m,n 

steady  state . 

The  differential  difference  equations  for  the  system  are  the 
following : 
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P0j0'(t)  -   -(OHP)   P0#0(t)  +  «  P„(1(t)  (1) 
P0jB'(t)   -   -fcHOHP)    P0>B(t)   +PP0f„.1(t) 

+  «   Pl,n-l(t>   +  «   P0,rM-l(t)  (S)    (n<K) 

Pm;0'(t)  .  -(a+p«)  PmjQ(t)  +a  Pm.1>0(t)  +m  Pm>1(t)                 (3)   (m<M) 

P%n'(t)  =  -(a+P  +  n+M)  P%n(t)  +  p  Pm)nil(t)  +W  Pm>n+1(t) 

(If)    (n<N, 

P0;N'(t)  =  -Ox+oO  P0>H(t)  +  p  P0>H.1(t)  +n  P^^Ct) 

+  «   Pj_  „(*)  (5)    (n=N) 

PM>n'(t)   =   -(WrtO)    PMjn(t)   +  p   P^.^t)   +  M   PM)n+1(t)  (g)    (m=M; 

+«pM.1)D(t)  r<N) 

Pm>N'(t)  .  -■(«+«i^)  Pm;N(t)  +  p  PmjN_l(t)  +  n  Pm+W(t)  ^  (m<^ 

+  aPm-l,M(t'  +n   Vl,H(t>  "=K)' 

PM)0'(t)  -  -(p+n)    PM;0(t)  +  u  PM>1(t)  +a  PM.1;0(t)  (8)  (-M) 

PM;H'(t)  -  -(u+a)    PM)K(t)  +  p  PM;K_l(t)  +a  PM_1>H(t)  (9)   (^M, 

Equations  (1)  -  (k)   can  be  recognized  as  the  differential  difference 
equations  for  the  dual  infinite  queue.  Equations  (1)  -  (k) ,    (5),  and 
(7)  are  the  equations  for  the  system  (<»,  n),  where  (oo,  n)  denotes 
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an  infinite  queue  for  server  1  and  a  queue  of  length  N  for  server  2 . 
Equations  (l)  -  (h) ,    (6),  and  (8)  are  the  differential  difference 
equations  for  the  (M,  °o)  system.  Equation  (9)  distinguishes  the  (M,N) 
system  from  the  (M,  °°)  system  and  the  (oo,  N)  system. 

Equation  (7)  (m  in  system  1  and  n  in  system  2)  results  from 
the  following  argument .  For  M>0,  an  arrival  at  time  t  +  At  will  find 
m  in  system  1  and  N  in  system  2  if  and  only  if  one  of  the  following 
mutually  exclusive  and  collectively  exhaustive  events  occur: 

1.  If  at  time  t  there  are  m  in  system  1  and  N  in  system  2, 

and  in  the  interval  At  there  are  no  arrivals  in  system  1  and  no  services  in 
either  server. 

2.  If  at  time  t  there  are  m  in  system  1  and  N-l  in  system  2, 
and  in  the  interval  At  there  were  no  arrivals  to  queue  1,  one  arrival 
to  queue  2  and  no  services  at  either  server. 

3-   If  at  time  t  there  are  m+1  in  system  1  and  N  in  system  2, 
and  in  the  interval  At  there  are  no  arrivals  to  either  queue  and  no 
service  to  server  2,   but  server  1  completes  a  service,  which  is  lost 
to  the  system  since  the  queue  for  system  2  is  full. 

k.      If  at  time  t  there  are  m+1  in  system  1  and  N-l  in  system  2, 
and  in  the  interval  At  there  are  no  arrivals  (a  and  p)  to  either  queue 
from  the  outside  and  server  1  completes  a  service,  while  server  2  does  not. 

5-   If  at  time  t  there  are  m-1  in  system  1  and  N  in  system  2, 
and  in  the  interval  At  there  is  an  arrival  to  queue  1  and  none  to  queue  2, 
while  neither  server  completes  a  service. 
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The  following  difference  equation  results  from  the  above  argument. 

P     „(t  +  At)  =  P     w(t)    (1   -  a  At)    (1)    (1   -  n  At)    (1  -   U  At) 

m,  JM  m,  in 

+  Pm  N-1(t)    (l  -  a  -  At)    (1  -  ju  At)    (1  -  h  At)  p  At 

+  Pm+1  N(t)    (1   ~  ^  At)    (1)    (1   "   W  At)   "  At 

+  Pm+1  N-1(t)    (1   -  a  At)    (1   -  (3  At)    (1   -   fi  At)   n  At 

+  P  (t)    (1   -  fl  At)    (1  -   |U  At)    (1)  a  At        . 

Ill —  -L  y  x\ 

Transposing  the  term  P   (t),  dividing  by  At,  and  taking  the 

m,  n 

limit  as  At-*0,  we  obtain  equation  (7)  • 

To  obtain  the  steady  state  probabilities,  we  set  the  left  side 
of  equations  (l)  -  (9)  to  zero.   Solving  for  the  high  order  terms,  and 
putting  the  results  in  a  closed  form  yields  the  following  solution: 

Pm,n  "  plVP0,0      0  <  m  <  M,  0  <  n  <  N      p^  Prf  <1   (10) 
PM,n  =  plMp2np0,0      m  =  M,  0  <  n  <  N  p^  pT  <1   (ll) 

where  P    is  determined  as  follows: 


M   N        M-l  N         N 

1  =  Z   Z  P    =  Z  Z  p    +  S  Pm 

„   _  m,n     _   A  m,n     _  M,  n 

m=0  n=0   '  m=0  n=0  •       n=0 


ml  (fl-P2)(l-PTN+1)(l-PlM)  +  PlM(l-p2N+1)(l-pT)(l-Pl)) 

po,o  =  (i-pT)(i-Pl)(i-p2)  "   (12) 


where  p^  p2,  pT  <  1. 
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2-3-   System  Descriptors 


The  average  number  in  service  is: 


N         M  M   N 

L_  -  0-P„  n   +  I  1  -P„  _  +  Z_1'P  „  +  '  E   Z  2-P 

m=l  n=l 


;i;      0,0  n=1   0,n  m=i   m,0    "    "     m,  n 


=  P 


0,0 


(1-P2)(PT-PT    )  +  (l-p2)(p1-p1   ;  +  2p1  p2(l-p1) 


0      M     N+l         ,  M+l/n  ,       n         0      M     N+l/,  wn         n 

2p1    pT        p2   +   pTP2         (1+P2)    -   2px    p2         (l-p1)(l-pT) 


I+lWl         n        0     M      ,-,         Ns 


;i-Pi)(i-p2)(i-pt) 


where   p  ,    p2,    and  pT  <  1. 

The  average  number  in  System  1: 


(13) 


M  M  N 

E(m)   =     Z     mP     =     Z     m     Z     P 


nt?*l 


m 


m 


i=l        n=0        ' 


(1-PT        )Lp1(l-p1   )    -  Mpx   (l-p1)J 
(l-pT)(l-Pl)2 


+ 


Mp1    (1-P2         ) 
(iTpT) 


P 


0,0 


(Ik) 


where    P;L,    pT  <  1 
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The  average  number  in  System  2  is: 


N 


E(n)  =  Z  nP 


n=l 


N     M 
Z  n  Z  P 
n=l   m=0  m'n 


(l-PlM)[pT(l-pTN+1)  -  (N+l)(l-pT)pTN+1] 


(i-Pl)(i-pTy 


+ 


Mr  /  N+lx  /Wl1\/n  \         N+ln     ' 

(l-p2)2 


0,0 
(15) 


where   p^,    pg,    p^  <  1. 

The   average   number   in  the   system  is  given  by  the  following  sum: 

1.  Expected  number   in  the   transmitter's   system,   E(rn), 

2.  Expected  number  in  the  processor's   system,   E(n). 
Summing,   we   obtain 


M  N 


N  M 


E(m,n)   =  E(m)   +  E(n)   =     Z     m     Z     P         +ZnZP 


,  _     m,  n  .  A     m,n 

m=l        n=0        '  n=l       m=0        7 


(1-p        )Lp1(i-p1  )  -  Mp1  (i-p1)J 

(l-pT)(l-Pl)2 


MP]L    (l-p2         )         (1-p      )LpT(l-pT        )-(N+l)(l-pT)pT        J 
+     +     


1-Po) 


(l-p1)(l-PT)' 


+ 


p±    [p2(l-p2         )    -    (N+l)(l-p2)p2         J 

(1-P2)2 


0,0 


(16) 


where   P][,    pT  <  1 
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The  average  number  in  the  transmitter's  queue  is: 


M        N 
L  -  =    E  (m-1)   E  P 
ql    m=l      n=0  m>n 


(1-PT    )[p1  (1-Pl    )-Mp1  (1-P^Pl  (l-p^J  (M-l)p1  (l-p2    ) 


(l-p^U-p^ 


+  • 


(1-P2) 


0,0 

:i7) 


where  p±,    p^  <  1. 


The  average   number  in  the  processor's  queue  is: 


N  M 

L  0  =       E  (n-1)     E     P 
q2  v  m, n 

n=l  m=0        ' 


(l-p1M)[pTN+1(l-pT)-(N+l)pTN+1(l-pT)+PT2(l-pTN)] 

(l-Pl)(l-pT)2 


+ 


P1M[p22(l-P2N)-(N+l)p2N+1(l-p2)+P2N+1(l-p2)] 

(1-P2)2 


■o,o 


(18) 


where   p^,    pT  <  1. 


The  total  number  in  the  queue  L  can  be  expressed  as  the  sum 

L  =  L  .  +  L  _. 
q    ql     q2 


For  System  1: 


M   N 
Pn(>0)  =  E   E  P 
1       m=l  n=0  m'n   ' 


2k 


This  is  just  the  probability  that  there  are  one  or  more  jobs  in  System  1. 


Pj_(>  0)  = 


(1-P1    )p1(l-pT    )    p1  (l-p2    ) 

(i-p.)(i-pj      +     n^pTi 


a- 


TV 


J2' 


0,0 


(19) 


The  average  waiting  times  are  derived  from  the  following  argument 
A  job  entering  System  1  will  find  r\   jobs  ahead  of  it.   After  these  r\   have 
been  served,  it  will  be  first  in  the  queue  and  must  then  wait  for  one  more 
service  before  it  can  go  into  service .   So, 

rl  =  Lql//Pl(>°)  andWl  =  (T1+l)/fi  =  (Lql//pl(>°)  +  l)//fi   ' 

This  is  the  waiting  time  given  that  the  job  waits  (i.e.  W,J p, (>  0  )) . 
Therefore, 


Wl  =  [Lql  +  Pi^>0)Vfi   ' 


/.         N+lxr      M,,         v    w/n         n      M        /.        M-1N1        .,     M/n         N+lT 
(1-PT        )[Pl   (l-p1)-M(l-p1)p1  +p1(l-pJ        )]+Mp1(l-p2        ) 


(l-pT)(l-Pl)' 


(1-P2) 


where    P1,PT<  1- 

For  System  2, 


po,o/fi 


(20) 


N       M 


Po(>  o)  =    S.    Z    p 


-     m,  n 
n=l  m=0        ' 


This   is   the  probability  that  there   are   one   or  more   jobs   in  System  2. 
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P2(>0)     = 


(1-p-j^  )pT(l-pT  )       px  p2u-p2   ) 
(1-P;L)(1-PT)       +  (ITp~l 


0,0 


(21) 


Similarly,  with  p  ,  p  <  1 


w2 


[Lq2  +  P2(>°)Vlu 


M> 


Nn 


N+l, 


N+l, 


+ 


(l-Pl)[pT(l-PT  )-(N+l)pTi^(l-PT)+PT1^(l-PT)] 
(l-Pl)(l-pT)2 

Mr    ,,     Nn   ,„,_%    N+l/,     \,n    N+l/,     Nl 

p1  Lp2(l-P2  )-(N+l)p2    (l-p2J+P2    (1-P2)J 


(1-P2) 


W^ 


(22) 


In  summary,  the  total  waiting  time  of  a  job  for  the  system  is 
dependent  on  where  it  enters  the  system.   If  it  joins  the  system  as  part 
of  the  stream  (3,  then  the  expected  waiting  time  will  "be  W  =  Wp,  hut  if  the 
job  joins  as  part  of  the  stream  a,    then  the  expected  waiting  time  will  be 
¥  =  W,  +  Wp •  As  can  be  seen,  the  total  waiting  time  for  any  job  is  dependent 
on  the  number  of  transmissions  it  experiences  before  it  is  served. 

2 .k.        Limiting  Cases 

Case  1  (M,  oq  ): 

Letting  N-*oo  in  equations  (10)  and  (11)  does  not  affect  the 
solution  set  for  this  system,  since  (10)  and  (11)  are  independent  of  N. 
Equation  (9)  distinguishes  the  (M,N)  system  from  the  (M,  «>)  system,  where 
the  set  of  equations  for  the  system  (M,  oo  )  is  a  subset  of  those  for  the 
system  (M, N) .   This  further  supports  the  conclusion  of  equivalent  solution 
sets . 
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Equation   (12)  becomes: 

_±        (l-p2)(l-PlM)   +  PlM(l-Pl)(l-pT) 

Po,o     =  (i-pT)(i-Pl)(i-p2) 

where    p^  p0,    and   pT  <  1. 

A  summary  of  results  for  the  system  (M,  °°  )  can  be  found  in  Appendix  A. 

Case  2(oo  ,  N) : 

In  the  limit  as  M  -*oo  in  equation  (10)  and  (ll),  we  obtain  the 
solution  for  the  system  (oo,  N  )  .   Since 

lim    M  n  _      A 
M.00   pl  p2   P0,0  =  °   ' 

the  solution  set  consists  of  equation  (10)  alone,  where 

P0^0_1=  (1-PTN+1)/(1-Pl)(l-PT) 

with  p  ;p  <  1.  A  summary  of  the  results  for  the  system  descriptors 
can  be  found  in  Appendix  B . 

Case  3(°° >  °°) ' 

Letting  M  -*oo  and  N  -*oo  in  equations  (10)  and  (ll)  produces  a 
solution  set  of  equation  (10)  for  the  system  (oo,oo.)  where 

p0;0=  (i-pT)(i-Pl) 

with  p  ,  p   <1.   This  is  the  well-known  result  of  Morse  [28]  and  Saaty  [35] 
A  summary  of  the  results  for  the  system  descriptors  can  be  found  in 
Appendix  C • 
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3-   GENERAL  MODEL 

The  two  center  case  suffers  from  one  failing  and  that  is  the 
small  number  of  centers  over-simplifies  the  probability  matrix  A.  As 
a  result,  none  of  the  stream  splitting  from  the  output  stream  of  the 
transmitter  occurs.  We  will  develop  next  a  three  center  model  and  from 
that  generalize  to  the  n-center  model.  For  ease  of  computation  and 
notation,  the  probability  matrix  A  will  not  be  immediately  implemented. 
Specifically,  we  assume,  for  the  present: 

1.  All  of  center  l's  transmitted  jobs  are  sent  to  center  2, 
(i.e.  Oi   „  =  l),  and 

2.  All  of  center  3's  transmitted  jobs  are  sent  to  center  2, 
(i.e.  a   =  1). 

Figure  2.1  and  3*1  illustrates  the  three  center  case  with 
matrix  A  implemented  and  with  the  assumptions  above,  respectively.   The 
dotted  section  in  Figure  3»1  indicates  the  system  presently  under 
consideration. 

The  exponential  arrival  rate  for  the  processor  at  center  2  is  \ir 

c 

and  the  transmission  rate  for  centers  1  and  3  is  fi  and  Q  .   The  arrival 
rates  for  the  transmitters  are  Poisson  around  a  mean  of  a   ,  i  =  1,3,  and 
the  arrival  rate  for  the  processor  at  center  2  is  f3p .   The  queues  for 
the  transmitters  at  centers  1  and  3  are  restricted  to  K>1  and  M>1, 


CENTER  3 


CENTER  2 


Figure  3-1.   Three  Center  Model 
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respectively,  while  the  queue  for  the  processor  at  center  2  is  restricted 
to  N>1.  Units  that  enter  when  the  queues  are  full  are  lost  to  the 
system,  as  previously. 

Let  P     (t)  denote  the  probability  that  there  are  exactly  k 
units  in  System  1  at  time  t,  exactly  m  units  in  System  3  at  time  t, 
and  exactly  n  units  in  System  2  at  time  t  (CKk<K,  (KrrKM,  CKn<N)  . 
We  adopt  the  following  notation: 

1.  w  =  true  arrival  rate  to  center  2 

w  -  (X    +  a    +  p2 . 

2 .  p  =  total  traffic  intensity  at  center  2 


w 


/Vo- 


3-   p,=  traffic  intensity  for  transmitter  at  center  1 


pi =  ai/fir 


h.      pp=  traffic  intensity  for  the  processor  at  center  2,  exclusive 
of  transmissions 

P2  =  P2/u2- 

5 •   po=  traffic  intensity  for  transmitter  at  center  3 

P3  -  a3/v 

Note  that  the  probabilities  P,      totally  characterize  the 
r  k,m,  n 

system  at  steady  state .  Continuing  as  earlier,  the  differential  difference 
equations  for  the  system  (K,M,N)  are: 
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W(t)   =   -<«i+«3+P2>    P0,0,0^)   +  "2P0,0,l(t) 


(23) 


+  ^P0,0,n+l(t)   +fi3P0,l,n-l(t) 
+  nlPl,0,n-l™ 


(n  <  n; 


:w 


P0,m,0'(t)   =   -(Wp2+fil)    P0,m,0^ 

+  a3P0,m-l,0(t)   +^2P0,m,l(t; 


(m  <  M) 


(25) 


Pk,0,0,(t^   =   "(«1+VP2+fi3)    Pk,0,0^ 


+  a,  p. 


0,1^' 


t)  +  ju0R 


(k<K)  (26) 


Pv  '(t) 

k,m,  n 


-(a1+o;3+p2+n1+n3+^)  Pk^n(t) 

^k^n-l^   +^2Pk,m,n+l(t) 

+  fi3Pk,m+l,n-l^)   ^iVl^n-l^ 


+  Q5-P.       .     (t)  +  olp.    ,         (t) 
3  k,m-l, nv  1  k-l,m,  n 


(m  <  M 
n  <  N 
k  <  K) 


(27) 


?0,0,N,(t)   =   -«*!+ a3+ ^    P0,0,N(t>   +  P2V,N-l(t) 
+  J23P0,l,N-l(t)   +fllPl,0,N-l(t) 
+  fl3P0,l,H(t)  +fllPl,0,N(t) 


(n  =  N) 


(28) 
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P0,M,0'(t)   =    -(VP2  ftl}    P0,M,0(t)    +  VW,0(t) 


+  ^2P0,M,l(t) 


(m  =  M)  (29) 


PK,0,0'^   =   -K+P2+^3)    PK,0,0(t)   +  aiPK-l,Q,0^ 


+  ^2PK,0A(t) 


(k=  K) 


(30) 


Pk,M,n'(t)  =  -(VP2+^2+fil+fi3)  Pk,M,n^ 
+  P2PK,M,n-l(t)  +  ^2Pk,M,n+l^ 
+  a3Pk,M-l,n(t)  +Vw,M,n^ 
+  filPk+l,M,n-l^ 


(k  <  K 
m  =  M 
n  <  N) 


(3D 


PK,m,n,(t)  =   -<«X+ 02*  ^+ V  ^    %mJV 

+  ^\m,n-l^   +  ^2PK,m,  n+l(t) 
+  aiPK-l,m,n^)+a3PK,m-l,n(t) 

+  VK,m+l,n-l^ 


(k  =  K 
ra  <  M 
n  <  N) 


(32) 


Pk,m,N,(t) 


-(ai+a3+M2+ni+fi3)    Pk,m,N(t) 

+  Vk+l,M-l(t)+a3PM-l,H(t) 


+  Vk.l,m,U(t)  +  n3Pk,^l,N^) 


(k  <  K 
m  <  M 
n  =  N) 


(33) 


+  n  p  (t) 

1  k+l,m,N     ' 
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PK,M,N'(t)  =  -(^+0i+03)  PK,M,N(t)  +  ^PK,M,N-l(t) 

(k  =  K      (3k) 

+  a3PK,M-l,N(t)  +aiPK-l,M,N(t)  m  =  ^ 

PK,M,n'(t)  =  -(P2+S!1+  fi3  +  "a5  PK,«,.(t)  +a3PK,M-l,n(t' 

+  Vw.H.'*'  +  ^K.M.n+l'*'  (k  "  5       (35) 

'  7          '  '  m  =  M 

4-R  P          ft)  n<  N) 

PK,m,N'(t)  =  -(a1+ft1+ft3+(X2)  PK,m,N(t^  +  a3PK,m-l,N(t) 

+  aiPK-l,m,N(t)+P2PK,m,N-l(t)  (k^       (36) 

7  '                          '    '  m  <  M 

+  n3PK,M+l)K-l(t)+ft3PK,m+l,N(t'  ^^ 

Pk,M,N'(t)  "  -(«3+nl+03+,12)  W'^UW**' 

+  a3Pk,H.l,K(tl  +  QA+l,H,lf-l(t»  <k  <  I                 ^ 

7                                            '  m  =  M 

+  aiPk-l,M,N(t)  +I,lPk+l,«,N,t)  ^^ 


Equations  (12)  -  (26)  are  derived  as  equation  (7)  was  in  the 
two  center  development.   If  we  set  the  left  side  of  (12)  -  (26)  to  zero, 
then  the  steady  state  solution  to  this  set  of  equations  is  as  follows: 
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k     m     n 
*k,m,n  Pl   P3   PT     0,0 


0  <  k  <  K  ,    0<m<M,0<n£N 


(38) 


k     M     n 
k,M,n  pl   p3   Pi     0,0 


0  <  k  <  K  ,    m=M  ,  0<  n  <  N         Pi=(P2+  a]_)/ju2      /^ 


■n  K     m     n 

K,m,  n  Kl   ^3   Hj      0,0 


k-K  ,    0  <  m  <  M  ,  0<n<N  p.=  (P2+  CK   )/jUg      (1*0) 


P  K     M     n 

K,M,n  pl  p3   P2   ^0,0 


k=K  ,   m=M  ,  0  <  n  <  N 


(in) 


where  P0  n  n   is  as  follows: 


-1 


0,0,0 


(l-PTN+1)(l-P1M)(l-P3K)(l-P2)(l-PJ)(l-Pi)  +  (1-P2N+1)(1-PT)(1-P1) 


N+lw-,    Kv 


(l-p3)(l-p.)(l-p.)p3Kp1M  +  p1M(l-pii^JL)(l-p3IV)(l-pJ)(l-p2)(l-pT) 
(1-Pl)  +  P3K(l-pjN+1)(l-p1M)(l-p3)(l-PT)(l-P2)(l-Pi)"l   / 


l-pT)  (1-Pl)  (l-p2)  (l-p3)  (l-p.  )  (l-p..) 


with  px,  p2,  p  ,  pi,  p  ,  and  pT  <  1. 

As  a  limiting  case,  consider  the  system  (oo,  w,  oo),  then 


p0,o,o   -  i/(i-pT)(i-Pl)(i-p3) 


as  expected,  where  p..,  p_  and  p  <-  1.  Limiting  cases  for  the  other  possible 
systems  can  be  developed  as  earlier.   These  derivations  are  left  as  an 
exercise  for  the  reader. 
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The  interesting  point  to  be  noted  here  is  that  as  extra  input 

streams  are  added  to  the  model,  the  complexity  of  the  model  is  enormously 

increased  both  in  the  number  of  equations  ■which  must  be  considered  and 

in  the  expression  for  P _  _    itself.   The  number  of  equations  to  be 

'  '  m 

considered  at  the  zero  boundary  is  Z  (  )  and  at  the  maximum  queue 

n=0  n 

m 
length  boundary  the  number  is  E  (  )  where  m  is  the  number  of  centers. 

n=l  n 

These  increase  rapidly,  to  say  the  least,  and  make  any  hand  analysis 

cumbersome  . 

From  these  two  models,  however,  several  points  can  be  noted. 

A  general  solution  for  the  n-center  model  can  be  hypothezied.   In  general, 

we  denote  the  attainment  of  maximum  length  by  an  "_"  (an  underbar),  then 

P  a  b     nP 

a,b,c,  ...,n     pl  p2    *PT  0,  ...,0  where  p  =  (a  +  a  +  •••  +  a.+  p)//j 

Pa,b,...,n=  PlV'--Pimpjnp0,...,0where  Pr(P  +Q;2+---+aiVM      (*3) 
Pa,b,c,  ...,n  =  Piap2-P3C-  '  'P±W  •  •  .0  Where  pj=(P  +  ai  +  a3+-  '  '+  a±)/u 


Pa,b,c,...,n=  Pl-P2-p3C'-'PimpjnP0,...,0where  pj=(P  +  <*3+>  ~+ <*±W» 


Pa,b,...,i,n  =  pl-p2"---prpjnp0,...,0  where  PJ=P/m  W 
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From  which  the  general  trend  in  probabilities  can  be  deduced.   If  one  or 

more  of  the  n  streams  has  attained  its  maximum  length  that  term  in  p.  is 

deleted.  The  only  exception  to  this  is  the  stream  with  input  parameter  (3 

(the  processing  center),  a  maximum  length  does  not  delete  (3  from  the  p. 

J 

expression. 

For  example,  consider  equation  (k-3)  •  What  this  implies  is  that 
if  a  center  other  than  the  processing  center  has  attained  its  maximum 
length,  then  the  input  stream  to  the  processing  center  for  the  duration 
of  this  maximum  length  has  in  effect  n-1  streams  in  place  of  its  original 
n  streams.   In  general,  for  i  maximum  lengths,  there  are  n-i  streams  in 
place  of  n  streams  to  the  processing  center.   Note  this  is  only  for  maximum 
length  boundary  conditions  at  the  sending  centers. 

Throughout  the  previous  development,  the  existence  of  the 
probability  matrix  A  has  been  ignored.  This  shall  now  be  incorporated  into 
the  model.  Figure  2.1  illustrates  the  queueing  situation  with  the  imple- 
mentation of  the  probability  matrix  A  for  the  three  center  model.  This  is 
a  more  accurate  picture  of  what  occurs  within  the  network  since  not  all 
jobs  at  center  1  and  3  will  be  transmitted  to  center  2.  Some  portion  will 
be  sent  to  the  other  centers.   It  is,  therefore,  a  more  realistic  description 
of  the  function  of  the  transmitter  to  add  the  probability  matrix  A  to 
the  model. 

Each  job  which  enters  the  transmitter's  queue  has  a  probability 
a   of  being  sent  from  center  i  to  center  j  and  a  collective  probability 

J.  J 

of  (l  -  a. .)  of  being  sent  elsewhere.  This  added  restriction  does  not 
ij 

affect  the  results  mentioned  earlier.   The  output  of  an  exponential  server 
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is  still  Poisson  with  Poisson  input  and  an  infinite  queue  [7] •   Therefore, 
adding  the  probability  a. .  in  effect  splits  the  Poisson  stream  into  two 
parts,  both  of  which  are  still  Poisson. 

The  general  solution  then  becomes  for  the  three  center  model: 


Pk,M,n  "  pl  f>3  Pi  P0,0,0  0  <  k  <  K  ,  m=M  ,  0<n  <  N 

PK,m,n  "  PlWP0,0,0  k=k  .  0  <  m  <  M  ,  0  <  „  <  N 

PK,M,  n  "  PlKP3VP0, 0,0  k=k  ,  m=M  ,  0  <  n  <  N 

V,n  ■  Pl  P3  pT  P0,0,0  0  <  k  <  K  ,  0  <  m  <  M  ,  0  <  „  <  H 

where  the  following  definitions  are  used: 

1.   p_  =  total  traffic  intensity  for  the  processing  center,  center  2 


^T  =  (aiai2  +  a3a32  +  ^2^2 


2.   p.  =  traffic  intensity  with  center  3  blocked 


\  =    (aiai2  +  $2)1^2.' 


3-   p.  =  traffic  intensity  with  center  1  blocked 
J 

"pj  =  (a3a32  +  ^^2' 


In  other  words,  center  2  is  no  longer  seeing  all  of  the  original  stream 
from  the  transmitter,  but  only  part  of  it.  Therefore,  with  this  change 
the  previous  results  describe  the  model.  In  an  analagous  manner,  these 
comments  can  be  implemented  in  the  n-center  model  to  yield  the  following: 
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Pa,b,  ...,n=    plV'  •  '*t\  .  .  .,0  Where   ¥(aiV"  '  '+  aiain+  ^ 

Pa,b,  .  .  .,n  =    plV-  '  ^\  .  .  .,0  Where    Pj=(a2a2n+'  '  *+  aiain+  ^ 

Pa,b,c,  . .  .,n  =    piap2-p3C*  *  -pimpjnp0,  ■  •  .,0  where    Pf  <aialn+  ^3%+* '  *+ 
Vin+PVM 

Pa,b,c,  , .  .,n  =    pl-p2-p3C  ' "  'V^^O,  -  •  .,0  Where   e^V" " '+  aiain+  ^ 

_  a     b     c  m     n^  ,  „  / 

Pa,b,c,...,i,n  =    pl-p2-p3-'-pi-pj   P0,...,0  where   pj  =  ^ 


With  these  comments  and  for  the  reasons  cited  earlier,  further 
development  of  the  n-center  model  is  left  to  future  research. 
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k.        PRIORITY  QUEUEING 

k.l.        System  Description 

In  the  preceding  analysis,  the  assumption  has  been  that  jobs 
are  serviced  in  the  order  of  arrival  or  first-come,  first- served.  This 
need  not  always  be  the  case  as  there  exist  many  situations  where  higher 
priority  jobs  may  displace  lower  priority  jobs  in  the  queue.   This  is 
true,  for  instance,  in  freight  handling  where  perishable  goods  have 
priority  over  non-perishable  goods  and  machine  maintenance  where  critical 
maintenance  preempts  any  non-critical  maintenance  on  the  work  schedules. 
The  overall  effect  is  that  the  waiting  time  for  the  lower  priority  jobs 
is  increased  as  it  experiences  this  displacement  by  the  higher  priority  jobs. 

This  concept  has  been  applied  with  little  modification  to  a 
computer  center.   In  every  system,  there  will  be  some  jobs  demanding  a 
faster  turnaround  than  others,  since  by  the  very  nature  of  the  job, 
not  every  job  requires  the  same  turnaround.   Using  this  knowledge  can  make 
each  center  in  the  network  more  responsive  to  those  jobs  requiring  a 
faster  turnaround  at  the  expense  of  those  jobs  requiring  a  slower  turnaround, 
One  way  of  implementing  such  a  scheme  is  through  the  use  of  priorities. 
Jobs  requiring  immediate  turnaround  can  be  given  a  higher  priority  than 
those  jobs  to  which  turnaround  is  not  so  essential.  At  the  same  time  as 
the  increase  in  priority  a  corresponding  increase  in  computer  charges 
can  occur.   In  other  words,  the  center  manager  may  choose  to  implement 
a  pay-for -priority  scheme,  with  the  obvious  advantage  of  making  more  of 
the  users  happy  more  of  the  time . 
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To  implement  this  scheme,  we  will  take  the  two  node  model 
discussed  in  Chapter  2  and  overlay  a  priority  scheme  on  the  arrivals 
to  the  transmitter  and  the  processor.  We  shall  assume  that  the  priority 
assignment  is  universal  throughout  the  network,  but  we  shall  restrict 
our  attention  to  a  particular  center's  view  of  these  jobs.   In  other 
words,  a  priority  1  job  has  priority  1  in  all  centers,  but  in  particular, 
our  model  is  considering  the  effect  of  priority  1  jobs  in  the  transmitter 
or  processor  separately.  Figure  k.l   is  an  illustration  of  the  priority 
model  under  consideration,  note  the  similarity  with  Figure  2.3-   Under 
the  priority  scheme,  jobs  of  a  lower  priority  may  be  displaced  by  jobs 
of  a  higher  priority  in  the  queue.   Once  any  job  has  entered  the  server  no 
preemption  is  permitted.  Among  jobs  of  equal  priority  in  the  queue, 
service  is  first-come,  first-served. 


CENTER  2 


CENTER  1 


Figure  k.l.      Two  Center  Network  with  Transmission  Priorities 


1+0 


Let  P>   be  the  arrival  rate  to  the  processor  at  center  2  and 
a  the  arrival  rate  to  the  transmitter  at  center  1  for  jobs  of 
priority  r   (1  <  r  <  R)  . 

Let  fi  be  the  service  rate  for  jobs  at  the  transmitter  in 
center  1  and  p.,    the  service  rate  for  the  processor  at  center  2.   The 
total  number  of  priority  classes  is  given  by  R,  and  the  queues  for 
system  1  and  2  are  bounded  by  M  >  1  and  N  >  1,  respectively.   Then, 
to  the  definitions  given  earlier  we  add  the  following  (where  1  is  a 
high  priority  and  R  is  a  low  priority  assignment): 

1.  Total  arrival  rate  to  the  transmitter  of  all  priority  classes 

R 

a  =  E  a 
r=l 

2.  Arrival  rate  for  jobs  of  priority  r  or  higher  to  the 
transmitter. 

r 

\    =    Z  a, 

r       k 
k=l 

3-   Traffic  intensity  for  priority  r  or  higher  jobs  in  system  1. 


Pxir 


)  =  \> 


h.      Total  traffic  intensity  for  priority  r  or  higher  jobs 
in  system  2 . 

PT(r)  =  (p  +\r)/n    . 


1+1 


Let  P     (t)  denote  the  probability  that  there  are  exactly 
(m-l)  units  of  priority  r  or  higher  in  system  1  at  time  t  and  exactly 

n  units  in  system  2  at  time  t.  That  is,  the  job  arriving  at  time  t 

th 
to  system  1  is  m —  away  from  service.   Note  that  the  set  [(1-p  (>0), 

P     ]  totally  characterizes  the  system  at  steady  state. 
m,r,n 

The  differential  difference  equations  for  the  system  are 
determined  as  before  and  at  steady  state  we  obtain  the  following: 


0=-(\+p+ft)p    n  +  XP  .   n  +  uF         .  (krj) 

r        m,r,0    r  m-l,r,0     m,r,l 

0  =  -(p  +  n  +  id  +  \   )P      +  fiP  ,-,     ,  +  pP      . 

r  m,r,n     m+l,r,n-l     m,r,n-l 

+  uFm,  r,n+l  +  XrPm-l,r,n  CKm<M+l, (Xn<N        (kQ) 

°  =   "(fi  +  "  +  **>  V,N  +  **pm-i,r,N  +  ^m+l,r,N 

+  PPm,r,N-l+fiPm+l,r,N  (KrrKM+1,  n=N  (k9) 

0  -  -(^+^,0  +  u?1>Vjl  +  aP0^0  -  fiP^  (50) 

°  =   -(fi  +  Xr  +  ^  W,0  +  XrPM,r,0  +  ^W,l  m=M+1  ^D 

0  =   -Cn  +  M)PM+1^r^N  +  WmlfTf^x  +  VM,P,N  m=M+l,n=N  (52) 

o  -  -(p  +  n  +  M)PM+1^r^n  +  ^M+1,r,n+1  +  PVv  ,n-l 

+  \  PM,r ,  n  m=M+l>  CKn<N  (  53 ) 


k2 


Solving  for  the  high  order  terms  in  equations  (h"j)    -    (53)  and  putting 
the  results  in  a  closed  form  solution  yields  for  system  1: 


_,  /  xm-1    /  sn 

Pm,r,n  =  pl(r)    pT(r)  Pl,r,0 


■  pl(r)  p2  Pl,r,0 


(Km<M+l,  (Xn<N 
m=M+l,  CKn<N 


Let  p  (>0)  denote  the  probability  of  not  going  directly  into 


service  for  system  1,  then 


M+l   N 

:i-p1oo))+  z     z 

m=l  n=0 


=  1   and 


l,r,0 


l-PT(r)    )(l-P;L(r)  )    Pl(r)  (l-p2    ) 
(l-PT(r))  (1-Pl(r))   +  (I^T 


P1(>0) 


m 


k.2 .        System  Descriptors 

Average  number  of  priority  r  or  higher  in  the  queue  for  system  1, 
M    N 
Lqx(r)  =  Z    Z  Pn 


~    ~  m+l,r,n 

m=0  n=0     '    ' 


,N+1 


M> 


(l-PT(r)^"L)[p1(r)(l-p1(r)1V1)  -  Mp^r  )  (l-p^r) )  ] 


;i-PT(r))(l-Pl(r)r 


+ 


,,   /  vMh    N+ls 
Mp1(r)  (l-p2    ) 

(1-P2) 


l,r,0 


h3 


Average  number  of  priority  r  in  the  queue  for ■ system  1, 
Lqr1  =  Lq1(r>)  -  Lq  (r-l)  = 


N+1  [p1(r)(l-P1(r)M)-Mp1(r)M(l-P1(r))] 
(1-Pm(r)   )  


(l-pT(r))(l-Pl(r))' 


vMs 


M, 


N+1  [p1(r-l)(l-P1(r-l)i^Mp1(r-l)lvl(l-p1(r-l))] 

(l-pm(r-l)   )■" ' o 

T  (l-pT(r-l))(l-Pl(r-l))^ 


+ 


M(p1(r)  -p-j^Cr-l)  )(1-P2   ) 


■1.^,0 


r^l 


d-P2) 
Trivially,  Lql1  =  Lq-Jl) . 

For  a  priority  r  job,  given  that  it  is  not  displaced,  the  waiting 
times  are  derived  by  the  following  argument.  When  a  job  enters  the  queue, 
there  are  r\   units  ahead  of  it.  From  this  must  be  subtracted  the  term 


\ 


N 


Z  (M+l)P  -,    ,  to  account  for  the  situation  that  when  the  job  arrives  the 


n=0 


'M+l,r  ,n 


queue  can  already  be  full  of  priority  r  or  higher  jobs. 


W 


T)  -  (Lq  (r)  -  Z   (M+1)PM^    n)/p,(>0) 
r      1      ^_n      M+i,  r,  n   ± 


n=0 


The  job  must  still  wait  for  the  job  in  service  once  it  has  waited  for  these 

t]  jobs  in  the  queue.   Therefore,  the  total  waiting  time,  given  that  the 
r 

job  waits  and  is  not  displaced,  is 


w  =  (ti  +  i)/n 

r     'r 


kk 


Removing  the  condition  on  waiting, 


N 

wr  =  [(Lqi(r)  -  n2o(M+i)PM+1;r;n)  +Pl(>o)]/n 


=  l/n 


(1-p  (r)    )  -p 

T  (l-pT(r))(l-Pl(r))2 


l>r  ,0 


For  a  priority  1  job,  this  is  the  waiting  time  for  the  tagged  job  since 

it  cannot  be  displaced.  For  a  priority  r^l  job,  the  waiting  time 

becomes  infinite,  if  it  is  displaced  from  the  queue.   If  it  is  not 

displaced  from  the  queue,  then  it  must  wait  in  addition  for  those  higher 

priority  jobs  that  arrive  while  it  is  in  the  queue  and  that  take  a 

position  in  front  of  the  tagged  job.  Since  the  higher  priority  units 

arrive  at  a  rate  X     ,  for  the  duration  of  his  waiting  time  W  ,  the  job 

r-1  r 

must  wait  an  additional  time  of  X         W  /ju  •   Therefore,  denoting  equation  (55) 
by  Z,  the  waiting  time  becomes 


W  =  Z  +  X     _  W  / 
r        r-1  r' 


U 


=   Z/(1-Pl(r-1))  . 

U.3-   The  Processing  System  -  System  2 

For  system  2,  the  processor,  a  similar  argument  can  be  used  to 

derive  the  following  solution.  Let  p  be  the  arrival  rate  to  the  processor 

at  center  2  for  priority  r  jobs  (l<r<R)  and  a,    the  arrival  rate  to  the 

transmitter  at  center  1.  Note  earlier  that  6.  referred  to  the  arrival 

i 
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th 
for  the  i —  center,  the  contex  should  clarify  the  meaning  intended.   Let 

fi  be  the  service  rate  for  jobs  of  priority  r  at  the  transmitter  in  center  1, 

and  ju  the  service  rate  for  the  processor  at  center  2.  Units  of  priority  r 

in  system  1  exist  even  though  priorities  are  not  in  use  since  the  priority 

assignment  is  universal.   The  total  number  of  priority  classes  is  given 

by  R,  and  the  queues  for  system  1  and  2  are  bounded  by  M>1  and  N>1, 

respectively.   The  following  definitions  hold: 

1.  Total  arrival  rate  to  the  processor  of  all  priority  classes, 

R 

B  =  £  B   . 

r=l 

2.  Arrival  rate  to  the  processor  for  units  of  priority  r  or  higher, 

r 
<r     =  E  B  ,  where  B  =  a . 
r   k=l  K  K 

3«   Traffic  intensity  for  jobs  of  priority  r  or  higher  in  system  2, 
exclusive  of  transmissions, 

P2(r)  =  V^  ' 
k.      Total  traffic  intensity  for  system  2  of  priority  r  or  higher  jobs, 

PT(r)"=  (a  +  <?r)/u. 


5-   Total  traffic  intensity  for  system  1  for  jobs  of  priority  r  or 

higher, 


Pl(r)  =  a/nr  . 


k6 
Let  Pm  n  r^  denote  the  Probability  that  at  time  t  there  are 
xactly  m  units  in  system  1  and  exactly  (n-l)  units  of  priority  r  or 
higher  in  system  2,    then 


Pm,n,r  =  ?!&    ^r)        P0,l,r 


(Xm<M,  CKn<W+l 


M   /  vn-1. 


/  \m       i     \u-j._ 

=  Pl(r)  p2(r)    P 


m=M,    (Kn<N+l 


Let  p  (>0)  be  the  probability  of  not  going  directly  into 
service  for  system  2.   Then  using  a  similar  argument  as  used  to  derive 
equation  (5*0  we  obtain: 


■0,l,r 


(l-Pl(r)M)(l-PT(r)N+1)        M  (l-p2(r)W+1) 
(l-P1(r))(l-PT(r))  +  Pl(r)    d-P2(r)) 


-.-1 


P2(>0) 


h.k.        System  Descriptors 

Average  number  of  priority  r  or  higher  in  the  queue  for  system  2, 


M    N 


Lq2(r)  =  E    Z  nP 


m=0  n=0 


m,  n+1,  r 


:i-Pl(r)M)[pT(r)  -  (N+l)pT(r)N+1  +  NpT(r)N^] 
(l-Pl(r))(l-pT(r)) 


+  P1(r) 


M  [p2(r)  -  (N+l)p2(r)N+1  +  Np2(r)M] 
(l-Po(r)) 


0,l,r 


H7 
Average  number  of  priority  r  jobs  in  the  queue  for  system  2, 
where  trivially  Lq^i  =  Lq^l). 

Lc^r  =  Lq^r)  -  Lq^r-l)  = 


M  [pT(r)-(N+l)pT(r)N+1+NpT(r)N^] 
(1-P1(r)  )  


l-PT(r))(l-Pl(r)) 


[pT(r-l)-(N+l)pT(r-l)N+1+NpT(r  -l)N^]        . 

-  l  J   ;- (1-Pl(r-1)M) 


(l-Pl(r-l))(l-pT(r-l)) 


+  p,  ( r) 


M   [p2(r)-(N+l)p2(r)N+1+Np2(r)N^] 
(1-P2(r)) 


-  Px(r-1) 


f1  [p2(r-l)-(N+l)p2(r-l)N+1H-Np2(r-l)N^] 
(1-P2(r-1))   . 


0,1,  r 


r+1 


In  an  analogous  manner  to  system  1,  for  a  priority  r  job 
that  is  not  displaced  from  the  system,  r\     is  the  number  of  jobs  in  the 
queue  when  the  jobs  enter  the  queue.   Given  that  it  waits, 


M 


T]  =  (Lq-^r)  -  (N+l)   Z  P 


m=0 


m,N+l,r)/P2(>°), 


where  the  term  (N+l)P  ^t  ..    accounts  for  the  situation  where  a  job 

m, N+l,  r  ° 

cannot  enter  the  queue  since  it  is  full.   Then  given  that  it  waits, 


\  -  (\   +  i)/m 


'Tir+  p2(>o))/m 


hQ 


=  l/u 


+   P1(r) 


M   [pT(r)-(N+l)pT(r)N  +  NpT(r)N+2] 
(l"Pl(r)  }  (l-PT(r))(l-Pl(rj)    " 


M  [p2(r)-(N+l)p2(r)N  +  Np2(r)N^] 


1-P2(r)) 


M, 


vN+1' 


l-p.(r)M)(l-PT(r)^)     Pl(r)"(l-%(rr) 
-n 1   w  /. r-TT + /'i  _  rn 


+   (l-Pl(r))(l-pT(r)) 


(1-P2(rl) 


0,l,r 


(56) 


For  a  priority  1  job,  this  is  the  total  waiting  time  since  it 
cannot  be  displaced  once  it  enters  the  queue.  For  a  priority  r/l  job, 
if  it  is  displaced  from  the  queue,  its  total  waiting  time  is  infinite. 
If  it  is  not  displaced  from  the  queue,  it  must  wait  an  additional  amount 
(J  ,  W  /fi,  following  the  analysis  given  for  system  1  waiting  time  statistics. 
The  total  waiting  time  for  priority  r^l  job  then  becomes,  denoting  equation 
(56)  by  Y: 

Wr  =  Y/(l-p9(r-l))  . 
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5-    NETWORK  TOPOLOGY 

In  Chapter  1,  three  classes  of  networks  were  defined.   In 
this  chapter  we  will  take  a  closer  look  at  a  representative  of  each  of 
the  topological  classes:   star,  distributed,  and  ring  structure.   The 
discussion  of  each  network  is  in  chronological  order  by  date  of 
implemen tation . 

From  this  survey,  the  parallels  "between  functioning  networks 
and  the  analysis  presented  earlier  should  become  apparent.  Moreover, 
the  need  and  the  direction  for  future  analysis  should  also  be  clear. 

5-1.   The  TUCC  Network 

196^  marked  the  start  of  the  Triangle  Universities  Computation 
Center  (TUCC)  network.   TUCC  is  a  regional  network  consisting  of  an 
IBM  360/165  at  Research  Triangle  Park  (RTC),  North  Carolina,  an  IBM  360/75 
at  the  University  of  North  Carolina,  Chapel  Hill,  and  two  IBM  36O/U0 '  s 
at  Duke  University  at  Durham  and  North  Carolina  State  University  at  Raleigh. 
In  addition,  k-0   institutions  are  connected  by  terminals  to  the  network. 
Each  of  the  campus  centers  at  Duke,  North  Carolina  State  and  the  University 
of  North  Carolina  view  TUCC  as  a  pipeline  through  which  they  get  massive 
computing  power  to  service  their  users.  Most  of  the  communication  is  to 
the  Research  Triangle  Park  and  there  is  little,  if  any,  intracenter 
communication  otherwise.   Consequently,  direct  center  to  center  links  were 
not  provided.   Figure  5-1  illustrates  the  star  topology  characteristic 
of  the  TUCC  network. 
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Figure  5-1.   The  TUCC  Network 


The  primary  motivation  for  the  development  of  TUCC  was  economics: 
To  give  each  of  the  institutions  access  to  more  computing  power  at  lower 
cost  than  they  could  provide  individually.   One  of  the  universities 
concluded  that  it  would  cost  them  about  $19,000  per  month  more  in  hardware 
and  personnel  costs  to  provide  all  their  computing  services  on  campus 
than  it  would  cost  to  continue  participation  in  TUCC.   This  would  represent 
a  kO   percent  increase  over  their  present  expense  for  terminal  machine 
communications,  and  their  share  of  TUCC  expense. 
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There  are  other  obvious  advantages.  First,  application  programs 
and  ideas  are  easily  exchanged  and  shared.  A  tangible  savings  is  that 
single  copies  of  computer  software  packages  can  be  purchased  and  made 
available  at  one  site  for  general  use.   In  this  way,  duplication  of 
programming  and  its  cost  is  avoided  since  once  a  program  is  developed  it  can 
be  used  anywhere  in  the  network  without  difficulty.   Secondly,  the  member 
universities  are  better  able  to  attract  and  keep  faculty  members  who 
require  large-scale  computing  facilities  for  research  and  teaching  purposes. 
This  is  a  tangible  adyantage  not  only  for  the  large  universities,  but 
also  for  the  smaller  member  institutions. 

Individual  machine  characteristics  are  used  to  greater  advantage 
and  profit  at  considerable  cost  savings  to  all  users,  since  a  general 
need  exists  in  many  installations  to  access  large  or  perhaps  differently 
configured  systems  for  parts  of  their  regular  batch  computing  needs. 
This,  in  turn,  implies  more  efficient  utilization  of  the  total  resources 
and  improved  turnaround  through  greater  system  balance. 

A  third  advantage  is  the  ability  to  attract  competent  system 
programmers  and  managers.   In  general,  these  personnel  could  not  have 
been  attracted  to  work  in  the  environment  of  the  individual  institutions 
because  of  salary  requirements  and  because  of  system  sophistication 
considerations  . 

For  the  most  part,  communication  is  over  low  to  medium  speed 
terminals  to  the  RTC .   The  OUTWATS  line  presently  in  use  allows  output  to 
queue  up  for  all  active  dial-up  terminals.   Once  the  job  is  received  at 
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RTC  its  position  in  the  processor  queue  is  determined  by  a  TUCC  priority 
selection  algorithm.  The  "basic  elements  in  the  determination  of  a  job's 
priority  are: 

1.  amount  of  computer  time  the  center  has  used  for  the  day, 

2 .  time  submitted, 

3-   specified  priority. 
Jobs  from  one  center  compete  with-  each  other  for  queue  position,  while 
between  centers  high  or  low  utilization  at  RTC  determines  the  job's 
relative  position  in  the  queue.   The  founding  universities  have  an 
additional  bonus  because  the  algorithm  defaults  unused  resources  to  one 
or  more  of  them  dependent  on  demand.   This  is  especially  effective  if 
their  peak  demands  do  not  coincide.   This  flexibility  is  a  major  advantage 
to  any  network  user.   (For  greater  detail,  see  in  particular  [6,  29,  31> 
and  37  to  ko]  . ) 

The  relation  between  TUCC  and  the  two-node  network  of  Chapter  2 
is  obvious.  Most  communication  in  TUCC  is  terminal  to  processor  or  the 
reverse,  where  the  important  feature  is  transmission  and  processor  service 
times.   Since  the  major  emphasis  in  TUCC  has  been  economic,  improved 
system  performance  and  any  benefits  that  might  be  reaped  from  it  are  of 
gene  ral  in ter e s  t . 

5-2.   The  ARPA  Network 

The  Advanced  Research  Projects  Agency  (ARPA)  network  began  two 
years  after  TUCC .  This  is  a  large  national  computer  network  which  views 
itself  as  a  set  of  autonomous  independent  computer  systems,  interconnected 
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so  as  to  permit  interactive  resource  sharing  between  any  pair  of  systems. 
In  other  words,  any  program  should  he  able  to  call  on  the  resources  of 
other  computers  much  as  it  would  a  subroutine.   Time-sharing  systems 
with  the  associated  software  sharing  are  already  prevalent  within  a 
local  community.   This  means  that  for  ARPA  to  be  feasible  it  must  offer 
such  sharing  on  a  nationwide  basis  in  such  a  way  that  communication  time 
is  transparent  to  the  users. 

Before  the  ARPA  topology  was  chosen  (Figure  5.2)  careful 
consideration  was  given  to  each  of  the  other  topological  classes.   The 
star  configuration  was  enticing  when  the  small  response  time  was  considered, 
but  was  at  a  disadvantage  when  reliability  and  alternate  routes  were 
demanded.  The  ring  structure  satisfied  the  reliability  requirements,  but 
failed  to  satisfy  the  two  second  response  time  stipulation.   The  result 
was  the  distributed  network,  combining  the  best  characteristics  of  both. 
To  protect  against  total  line  failure,  there  are  at  least  two  physically 
separate  paths  to  route  each  message  and  round  trip  delay,  because  of  the 
multiple  connections,  was  within  the  two  second  limit.   Thus,  the  topology 
of  ARPA  was  selected  to  minimize  the  cost,  maximize  growth  potential  and 
yet  satisfy  all  the  design  criteria. 

The  versatility  of  ARPA  stems  from  the  wide  variation  in  the 
resources  at  each  node.  As  many  unique  resources  (which  are  only  available 
at  a  small  number  of  centers)  as  possible  rather  than  common  resources 
(which  are  available  at  many  centers)  were  included  in  the  initial  twenty 
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Figure  5-2.   The  ARPA  Network 


node  configuration.   In  conjunction  -with  the  resources  available,  the 
nodes  were  chosen  so  that  the  communication  cost  was  less  than  25  percent 
of  the  computing  costs  of  the  system  connected  through  the  network. 

Study  of  the  communication  technology  showed  that  the  use  of 
conventional  line  switching  facilities  would  he  economically  and  technically 
inefficient.   To  resolve  this  difficulty  ARPA  decided  to  build  a  new 
kind  of  digital  communications  system  employing  wideband  leased  lines 
and  message  switching,  where  a  path  is  not  established  in  advance  and 
each  message  carries  an  address.  Since  ARPA  is  not  a  fully  connected 
network,  messages  normally  traverse  several  nodes  before  reaching  their 
destination.  With  this  in  mind,  at  each  node  a  copy  of  the  message  is 
stored  until  it  is  safely  received  at  the  following  node.   The  network 
is  thus  a  store  and  forward  system.  However,  with  this  decision  come 
problems  of  routing,  buffering,  reliability  and  many  more .  To  protect 
the  centers  from  these  network  problems  as  well  as  to  protect  the  network 
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from  center  problems,  each  node  has  a  small  processor  which  is  inter- 
connected with  the  remaining  network  to  form  a  subnet  and  to  connect 
each  center  into  the  network.   In  this  arrangement,  the  centers  are 
called  Hosts  and  the  processors,  Interface  Message  Processors  ( IMPs ) . 
This  in  effect  divides  the  network  into  two  parts,  a  subnet  and  the 
Hosts. 

To  complete  the  general  discussion  of  ARPA,  we  will  consider 
message  delay  in  ARPA,.   The  subnet  transmits  messages  over  unidirectional 
logical  paths  between  Hosts,  known  as  links.   On  a  given  link  at  any 
one  time,  only  one  message  may  be  accepted  and  the  link  is  blocked  to 
all  other  traffic,  until  the  message  has  been  received  and  acknowledged. 
Since  each  Host  has  more  than  one  link  all  traffic  to  or  from  that  Host 
is  not  blocked. 

Each  IMP  takes  the  message  from  its  Host  in  segments,  forms 
the  segments  into  packets  and  ships  each  packet  separately.  At  the 
destination  the  IMP  reassembles  the  packets  and  delivers  them  to  the 
Host  as  a  single  unit.   The  path  of  each  message  is  determined  by  a 
routing  algorithm  which  utilizes  the  total  estimated  transit  time  for 
its  decisions.   (This  is  further  discussed  in  [8  and  2l]  and  is  only 
included  in  this  discussion  for  completeness.) 

Each  IMP  has  a  buffer  storage  space  partitioned  into  about 
70  fixed  length  buffers,  each  of  which  has  the  capability  of  storing 
a  single  packet.   Message  delay  is  subject  to  a  variety  to  definitions. 
In  ARPA  delay  measurements  are  based  on  time  values  at  a  single  node  by 
utilizing  the  notion  of  round  trip  times  of  messages  and  acknowledgments. 
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In  a  queueing  model  of  ARPA  conducted  at  U.C.L.A.,  a  priority 
non-preemptive  system  of  the  model  was  investigated.   Priorities  were 
added  mainly  so  that  the  effect  of  the  higher  priority  acknowledgments 
and  requests  would  be  felt  in  contrast  to  ordinary  message  transmission. 
Service  time  was  defined  as  the  time  required  to  transmit  the  message 
across  the  channel,  and  is  dependent  on  the  message  length  and  the  channel 
capacity.   (For  a  more  detailed  description,  see  in  particular  [lO].) 

The  intent  of  this  section  is  to  demonstrate  the  applicability 
of  the  theory  developed  in  this  paper.   In  ARPA  the  basis  elements  are 
those  assumed  to  be  present  in  any  network:   queues,  transmission  time 
delays  (called  service  time  in  ARPA),  and  processing  time  at  the  center. 
This  also  demonstrates  the  strong  correlation  between  reality  and  the 
theoretical  model  while  reflecting  the  definite  need  for  analysis.   These 
analyses  affect  a  better  understanding  of  the  advantages  of  networks  and 
facilitate  remedying  network  difficulties. 

5 -3 •   Distributed  Computer  Network 

The  third  type  of  network  discussed  in  Chapter  1  is  the  ring 
structure.   This  philosophy  is  exemplified  in  the  Distributed  Computer 
System  (DCS).  DCS  is  an  experimental  network  system  designed  for  the 
University  of  California  at  Irvine  under  the  guidance  of  David  J.  Farber . 
In  Farber' s  words,  "the  Distributed  Computer  System  can  be  roughly 
sketched  as  a  system  of  different  processors  interconnected  by  a  common 
transmission  system.  Complete  control  of  the  system  is  distributed  in 
time  and  space  as  the  needs  arise  and  as  facilities  are  available." 
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In  order  to  adequately  understand  DCS,  it  is  necessary  to 
discuss  the  overall  aims  of  the  project  and  the  principles  used  to  attain 
these  aims.   The  design  objectives  proposed  were  reliability,  low  cost, 
incremental  expansion  capability,  a  variety  of  language  systems,  and 
modest  system  programming  requirements.   To  meet  these  ends,  a  number 
of  assumptions  were  made. 

In  order  to  provide  a  system  that  has  a  high  probability  of 
responding  to  a  high  percentage  of  users,  implying  that  most  users  should 
receive  what  they  request  most  of  the  time,  the  network  may  be  designed 
such  that  it  is  vulnerable  to  partial  failure.  Nonetheless,  the  network 
should  be  designed  so  that  it  is  invulnerable  to  total  failure.   That  is, 
an  effort  should  be  made  so  that  reliability  is  guaranteed  for  the  network, 
while  not  necessarily  for  each  component  in  the  network. 

To  attain  the  goal  of  low  cost,  minicomputers  were  used  on 
the  nodes  rather  than  larger  processors  such  as  IBM  36O ' s .   These  smaller 
machines  are  flexible  enough  to  provide  the  services  required,  while 
reducing  the  total  network  cost.  Furthermore,  in  linking  these  smaller 
machines  together,  the  system  performance  should  improve  as  the  work 
can  now  be  done  from  a  "pool"  of  resources.   There  is  also  a  gain  in  that 
system  performance  no  longer  becomes  dependent  on  whether  or  not  a  single 
machine  is  functioning  but  on  whether  the  entire  network  is  functioning. 

Incremental  expansion  capability  and  a  variety  of  language 
systems  were  specified  since  DCS  involves  a  university  community  whose 


58 


needs  are  continually  changing.  The  network  should  be  able  to  change 
with  these  needs.   In  this  sense,  a  modular,  regularized  system  has  the 
added  advantage  that  the  configuration  of  computers  or  compilers  can 
change  and  not  affect  the  system  performance  as  a  whole. 

The  next  question  to  be  resolved  is  the  actual  configuration 
of  the  network  and  the  principles  used  in  its  design.   The  DCS  network 
attempts  to  solve  this  problem  by  allowing  control  of  the  network  to 
reside  in  any  processor  which  is  free  to  do  this  task.  Therefore,  both 
the  switching  network  and  the  control  of  the  communications  system  is 
distributed.  Furthermore,  the  network  can  be  implemented  at  a  reasonable 
cost  since  cables  to  each  adjacent  ring  component  need  only  be  provided 
and  not  to  the  other  n  components.  At  worse,  to  maintain  the  reliability, 
cables  to  each  adjacent  and  semi-adjacent  node  (node -skipping)  need  to  be 
provided.   This  is  still  fewer  connecting  paths  than  required  by  a  richer 
topology  with  a  separate  path  between  each  component.   Processors  and 
languages  are  easily  added  around  the  ring  and,  therefore,  expansion 
presents  no  additional  problem.  (The  number  of  geographically  distributed 
processors  connected  to  the  ring  is  expected  to  be  approximately  30.) 
Finally,  the  ring  topology  is  ascethically  pleasing  in  that  it  is  a 
simple  structure. 

The  system  provides  for  processors,  file  machines,  and  terminal 
controllers  connected  in  the  ring.  Each  of  these  components  is  connected 
through  a  ring  interface  to  a  unidirectional  circular  communications  ring. 
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Figure  5«3«   The  Distributed  Computer  System 


In  addition,  a  PDP-10  is  connected  to  the  ring  to  facilitate  testing 
of  the  system.  From  the  above,  it  can  be  seen  that  the  prototype  system 
consists  of  minicomputers,  ring  interfaces,  and  interconnecting  cable. 
There  are  seven  minicomputers  of  approximately  l6K  capacity.   Three  of 
these  share  the  processing  load  while  two  minicomputers  with  disks  serve 
as  file  machines  and  two  other  minicomputers  are  terminal  controllers 
for  the  connection  of  terminals  to  the  system.   All  computing  (except 
that  performed  in  the  file  machines  and  by  the  terminal  controllers)  is 
performed  by  the  three  processing  machines;  thus  if  one  fails,  the  other 
two  can  continue  to  provide  service. 
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Messages  are  addressed  to  processes,  not  processors.   This  is 
accomplished  through  an  associative  store,  the  store  contains  the  names 
of  all  processes  and  files  active  on  the  attached  processor.  When  a 
message  arrives  over  the  ring,  the  destination  process  name  is  matched 
against  the  associative  store.   If  a  match  occurs  the  message  is  copied 
and  passed  over  the  ring  to  the  next  node.   The  message  is  removed  from 
the  ring  when  it  returns  to  the  node  where  it  originated.   The  ring  itself 
may  be  thought  of  as  a  series  of  message  slots.   To  transmit  a  message 
the  node  waits  for  an  empty  slot  and  when  one  is  found,  it  places  the 
message  on  the  ring.  The  message  is  copied  when  necessary  as  it  proceeds 
around  the  ring  and  checked  against  the  original  when  it  returns  to  the 
originating  node.  Note  also  that  this  scheme  allows  messages  to  be 
broadcast  to  all  processes  or  a  class  of  processes.  Furthermore,  it  is 
extremely  important  to  note  that  the  process  may  physically  be  anywhere 
on  the  ring  and  may  indeed  have  moved;  the  sender  need  not  know  this  to 
correctly  send  a  message. 

All  communication  appears  to  be  carried  out  along  the  ring  as 
far  as  the  processor  is  concerned  since  the  Resident  Message  Router  (RMR) 
routes  messages  from  the  ring  onto  the  Incoming  Message  Queue  (IMQ)  and 
places  messages  to  other  processes  into  the  Outgoing  Message  Queue  (OMQ) . 
Should  a  message  on  the  OMQ  be  destined  for  a  process  active  on  the 
host,  it  is  routed  directly  to  the  IMQ  by  the  RMR  and  is  not  placed  on 
the  ring,  although  it  appears  as  if  it  came  from  the  ring.   This  scheme 
allows  a  process  to  keep  the  same  address,  its  name,  even  though  it  has 
been  moved  from  one  host  to  another. 
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The  parallels  to  the  general  network  configuration  discussed  in 
Chapter  2  are  strong.  Each  processor  has  an  IMQ,  and  an  OMQ  which 
corresponds  to  the  transmission  and  processor  queues  at  a  single  center. 
Transmission  service  time  can  he  defined  as  the  time  it  takes  the  message 
to  travel  around  the  ring  including  the  time  necessary  for  finding  an  idle 
slot.   Processor  service  time  is  the  time  spent  in  service  at  the  processor, 
exclusive  of  its  time  in  the  TMQ.  With  this  clarification,  the  results 
derived  earlier  are  applicable  to  this  system,  irrespective  of  the  network 
topology.   The  essential  elements,  transmission  and  processors  are  present. 

In  this  discussion,  no  mention  was  made  of  many  aspects  of  the 
operating  philosophy,  such  as  garbage  collection,  idle  slot  detector, 
etc.   The  reader  is  referred  to  references  DA]  to  [17]  for  a  discussion 
of  these  aspects  of  DCS.   Our  purpose  here  is  to  outline  the  correlation 
between  DCS  and  the  general  network  configuration  developed  in  this  paper. 
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6 .    CONCLUSIONS 


in  this  paper,  we  have  taken  the  approach  ef  looking  at  a 
network  counter  at  douhle  arm's  length  and  seeing  what  the  general 
network  characteristics  are.  So  consideration  was  given  to  any  one 
center's  or  network's  individual  idiosyncrasies.  To  this  end,  we 
isolated  the  nomination  links  and  the  colter  center  as  the  two 
distinguishing  and  vital  elects  in  any  network  computer. 

The  philosophical  approach  in  this  paper  has  heen  that  networks 

a   *.-+  nf  1  ife  and  that  there  is  a  growing  need  to 
are  now  an  everyday  fact  oi  lire,  ana 

understand  and  improve  on  this  fact.  We  have  seen,  in  Chapter  2,  the 
general  model  description  and  the  degree  of  complexity  involved  in  a 
two-center  network.  Chapter  3  provided  a  partial  expansion  of  these 
results  to  the  n-nenter  network.  Again  the  complexity  and  unwieldness 
of  the  equations  increase  rapidly.  This  highlights  the  need  for  some 
super  analytical  tool  to  give  the  analyst  more  insight  into  the  intricacies 
of  his  work.  Simulation  is  one  such  invaluahle  tool.  The  next  step  an 
this  network  center  development  would  he  to  develop  a  simulation  model  to 
visually  and  graphically  portray  the  relationships  hetween  the  two  center 
and  the  n-center  networks.  Moreover,  alternate  methods  of  queueing,  such 
•  as  priority  and  nonprierity  queues,  could  he  investigated  with  a  minim™ 

,  •      of  these  areas  is  hy  no  stretch  of  the  imaginatio. 
of  effort.  The  work  in  any  of  these  areas  is  j 

a  *  „i  that  a  finaer  has  heen  pointed  down  the 
complete.  However,  we  do  feel  that  a  linger  n 

correct  road. 


63 


Network  computers  are  economically  feasible  only  if  they  can 
favorably  compete  as  an  alternative  to  standard  computing  techniques. 
To  do  so,  system  measures  and  guidelines  have  to  be  established. 
Chapter  2  through  k   represent  alternative  methods  of  network  analysis. 
Chapter  5  "was  included  to  demonstrate  the  direct  correlation  between 
today's  existing  networks  and  the  theoretical  network  discussed  in  this 
paper.  For  none  of  these  networks,  real  or  imaginary,  is  the  development 
or  analysis  concluded.' 
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APPENDIX  A 
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APPENDIX  B 


The  System   (»,    N) 

Solution:  P^n       =    P^V         Vm     °<n<^ 

i-  po,o"1=  (i-p/+1)/(i-p1)(i-pt) 
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[pT(l-PTN+1)    -    (N+l)(l-pT)pTN+1] 

k'        ^^  =     M         Ul        ^ 

(1-PT)(1-PT        ) 

m     N+1 

P1  Prn  NpT 

5-        E(m,n)     =     + 


1-PX)  (1-PT)         (1-PTN+1) 


2 
6-        L  x  =      p1  /(1-P1) 

PT    (1-PT    )    -    (N+l)pT        (1-PT)    +   PT        CI- ftp) 
(1-PT)(1-PT        ) 


8.      P1(>o)   =     Pl 

9-      P2(>o)    -     pt(i-ptn)/(i-ptn+1) 

io.      w  -    p  /(n  -  a) 

[pt(i-ptn)  -  (N+i)pTN+1(i-pT)  +  ptN+1(i-pt)] 

11 '        W2  =      Vu j^T 

(1-PT)(1-PT      ) 


67 


APPENDIX  C 
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